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Abstract 

Research  conducted  under  the  auspices  of  AFOSR  Grant  74-2631  on 
"Resolution  Space,  Networks,  and  Non-Sel f -Ad j oint  Spectral  Theory" 
during  the  period  April  1,  1977  through  March  31,  1978  is  surveyed. 
Specific  attention  is  given  to  the  solution  of  a Wiener-Hopf -like 
"Basic  Stochastic  Optimization  Problem",  the  solution  of  the  feedback 
system  stability  problem  for  nonlinear  and  time-varying  systems,  and 
the  formulation  of  a theory  of  systems  defined  in  a Banach  resolution 
space . 

I.  Introduction 

The  theory  of  operators  defined  on  a resolution  space  was 
initiated  a decade  ago  as  a mathematical  setting  in  which  to  formu- 
late  a unified  theory  of  linear  networks  and  systems.  ’ With 
the  aid  of  recent  progress  in  stability  theory114  and  Wiener-Hopf 
optimization  * * * , that  goal  is  now  in  sight.  Indeed,  it 

has  been  surpassed  in  several  areas  wherein  surprising  inroads 
have  been  made  into  the  nonlinear  theory . 5 * 14  * 15 

Our  research  during  the  past  year  may  naturally  be  subdivided 

into  three  areas  dealing  with  Wiener-Hopf  optimization  theory, 

stability  theory,  and  the  developement  of  the  foundations  for  a 

theory  of  operators  on  a Banach  resolution  space.  The  Wiener- 

Hopf  work  began  with  the  formulation  of  a Wiener  filter  for  oper- 

21  22  23 

ators  on  resolution  space  * * which  has  since  been  extended 

into  a "basic  stochastic  optimization  problem"  which  subsumes  most 
(all?)  of  the  quadradic  optimization  problems  studied  in  linear 

4 

system  theory.  These  include  the  Wiener  and  Kalman  filters,  the 
sevomechanism  and  optimal  regulator  problems,  the  principle  of 
optimality,  and  the  separation  principle.  The  resultant  theory 


mmm 


is  applicable  to  time-variant , distributed,  and  finite  time 
linear  systems  as  well  as  the  classical  linear  lumped  time-in- 
variant systems.  It  is  limited  only  by  the  requirement  that  cer- 
tain covariance  operators  have  a finite  trace  and  questions 

22 

surrounding  the  existence  of  the  "causal  part"  of  an  operator. 

Our  work  in  the  stability  area  has  been  centered  on  the  form- 
ulation of  necessary  conditions  for  the  stability  of  a general 

14 

nonlinear  feedback  system.  This  has  been  achieved,  in  part, 

s. 

through  the  formulation  of  homology  theory  for  the  set  of  causal 

invertible  operators  on  a resolution  space.  Here,  our  previously 

developed  theorem  to  the  effect  that  the  causal  invertibility 

X 6 

property  is  a homotopic  invariant  is  employed  to  map  the  set  of 

all  causal  invertible  operators  on  a resolution  space  onto  an 

appropriate  abelian  semigroup  in  such  a manner  that  the  oeprators 

which  admit  a causal  inverse  (and  hence  define  a stable  feedback 

system)  are  mapped  onto  the  units  of  the  semigroup.  By  explicitally 

constructing  his  homology  for  various  classes  of  operator  we  have 

successfully  replicated  most  of  the  classical  necessary  and  suffic- 

14 

ient  conditions  for  feedback  system  stability.  Moreover,  the 
technique  employed  appears  to  be  applicable  to  large  classes  of 
time-variant  and  nonlinear  systems;  a possibility  which  is  presently 
being  explored. 

Our  third  major  area  of  activity  during  the  past  year  has  been 
directed  toward  the  extension  of  the  resolution  space  concept  from 
Hilbert  to  Banach  space.  The  most  spectacular  result  in  this  en- 
deavor has  been  the  formulation  of  a miniphase  operator  factor- 
ization theory  for  operators  defined  on  a Banach  space  in  which  the 

2 3 24 

factor  space  is  a Hilbert  space.  * This,  in  turn,  implies  that 
the  reproducing  kernel  resolution  space  for  a (reflexive)  Banach 
space  valued  random  variable  is  a Hilbert  space  and  that  the 


scattering  variables  for  a network  defined  in  Banach  space  take  their 
values  in  a Hilbert  space.  * In  other  areas  a class  of  Orlicz 
resolution  spaces  have  been  defined  which  have  a "quasi-py thagorian 
property  that  allows  much  of  the  Hilbert  resolution  space  theory 
to  be  extended  to  an  Orlicz  resolution  space. 

II.  Wiener-Hopf  Theory 

Our  "basic  stochastic  optimization  problem"  is  characterized 

4 v 

by  the  block  diagram  of  figure  1.  Here,  a and  8 are  given  stochas- 
tic processes. 


Figure  1.  Block  diagram  for  the  "basic  stochastic  ( 
optimization  problem". 


the  are  (not  necessarily  causal)  operators  on  a resolution  space 

and  we  are  required  to  find  a causal  operator,  Dq , which  minimizes 

1.  J(D)  = E{ | |R| | 2 + 1 I e I I2) 

over  the  set  of  all  causal  operators.  A solution  to  this  problem 
is  given  by 


W!  ♦'  % + Ll9a6  ♦ q6«l!  1 


respectively,  and  [ Jc  denotes  the  "causal  part"  operator;  This 

solution  is  well  defined  whenever  the  "causal  part"  exists  and 

a,  0,  and  the  L,.  are  restricted  in  such  a way  as  to  guarantee  the 

4 

finiteness  of  J(D  ). 

o 

Interestingly,  this  single  "basic  stochastic  optimization 

problem"  includes  most  of  the  quadradic  optimization  problems 

classically  studied  in  system  theory.  For  instance,  the  restricted 

21  22  23 

Wiener  filter  derived  by  Tung  * * corresponds  to  the  special 

case  where  a and  B are  independent,  L = L0  = L_  = 1,  and  L = 0. 

A less  restricted  form  of  the  Wiener  filter  is  obtained  by  letting 
L3  = 1 and  = 0 with  a, 6,  and  L 2 arbitrary.  In  particular, 
if  L1  = 1 and  = P (and  ideal  predictor)  this  reduces  to  the 

4 

classical  Wiener  predictor.  Similarly,  by  letting  the  represent 

the  constituant  operators  which  make  up  a state  model  a Kalman 

filter  may  be  obtained.  In  this  case,  the  recent  theorem  of 
20 

Stienberger  is  used  to  transform  equation  2.  into  the  feedback 
structure  classically  associated  with  the  Kalman  filter. 

To  convert  the  "basic  stochastic  optimization  problem"  into 
a classical  open  loop  control  problem,  one  takes  L4  to  be  non-zero 
with  our  choice  of  o,  S,  and  the  defining  the  various  classical 
input-output  and  state  space  control  problems.  The  resultant 
open  loop  controllers  may  then  be  used  to  determine  equivalent 


1 


feedback  controllers  via  the  classical  transformation  of  variables. 

Of  course,  one  must  further  verify  the  stability  of  the  resultant 
feedback  controllers.  For  the  case  of  a state  space  feedback  con- 
troller or  an  input-output  controller  with  causal  open  loop  gain, 
this  presents  no  difficulty.  For  the  general  case,  however,  the 

stability  of  the  resultant  feedback  control  system  remains  an 
4 

- open  question . 

The  applicability  of  the  solution  to  the  "basic  stochastic 

optimization  problem"  given  by  equation  2.'  is  limited  only  by  the 

existence  of  the  "causal  part"  and  the  requirement  that  J(D  ) be 

o 

finite.  The  former  problem  was  studied  several  years  ago  and, 

c c i o i n 

unfortunately,  proved  to  be  highly  ill-posed.  * ’ * The  basic 

difficulty  lies  with  the  fact  that  the  "causal  part"  operator, 

viewed  as  a Banach  space  mapping  from  the  bounded  operators  to  the 

18 

causal  operators,  is  not  closed.  Indeed,  both  the  sets  of  oper- 
ators which  admit  a well  defined  causal  part  and  those  which  do  not 

admit  a causal  part,  can  be  shown  to  be  dense  in  the  bounded  oper- 
6 8 

ators.  ’ Of  course,  many  sufficient  conditions  for  the  existence 

8 7 8 

of  a "causal  part"  are  known.  * * On  the  other  hand,  we  believe  that  th 

finiteness  questions  surrounding  J(D  ) can  be  resolved.  Indeed. 

o * 

a careful  inspection  of  the  derivation  of  equation  2. 4 will  reveal 
that  the  given  solution  is  "formally  valid"  without  the  finiteness 
restriction. 

III.  Stability  Theory 

Our  main  activity  during  the  past  year  in  the  stability  area 

has  been  the  development  of  a homology  theory  for  the  class  of 

14 

caus&l  invertible  operators.  Basically,  this  homology  is  the 
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abelian1  semigroup  formed  by  the  connected  components  in  the  set 
of  causal  invertible  operators.  By  invoking  our  previously  derived 
theorem  to  the  effect  that  the  property  of  a causal  operator  having 
a causal  inverse  is  a homotopic  invariant16  it  then  follows  that  a 
causal  operator  has  a causal  inverse  if  and  only  if  the  connected 
component  in  which  it  lies  is  a unit  in  the  semigroup.  Indeed, 
this  result  is  a virtual  tautology.  Interestingly,  however,  we  have 
discovered  that  for  may  classes  of  operator  this  homology  may  be 
computed  explicitally  yielding  an  immediate  necessary  and  sufficient 
conditon  for  a causal  operator  to  admit  a causal  inverse.  By 
working  with  the  return  difference  operator  for  a feedback  system, 
this,  in  turn,  has  permited  us  to  replicate  all  of  the  classical 
necessary  and  sufficient  conditions  for  feedback  system  stability. 

This  includes  the  classical  and  multivariable  Nyquist  criteria, 
the  multd-imensional  Nyquist  criterion,  and  finite  dimensional  con- 
dition, and  the  stability  conditon  for  systems  defined  on  l*.14 

Although  homology  is  usually  considered  to  be  an  extremely  ab- 
stract concept,  it  is  ideally  suited  for  our  application  wherein  it 
transforms  a problem  defined  in  an  infinite  dimensional  space  of 


^Rigorously,  one  must  "abeliani ze"  this  semigroup  by  factoring  out 
its  comutator.  In  practice,  however,  the  comutator  has  been 
trivial  in  every  example  thus  far  constructed. 


(possibly)  nonlinear  operators  into  an  equivalent  problem  in  an 
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abelian  semigroup.  Indeed,  this  semigroup  has  proven  to  be 
finitely  generated  in  every  example  thus  far  constructed.  As  such, 
we  believe  that  the  above  described  homological  approach  is 
potentially  capable  of  yielding  necessary  and  sufficient  conditions 
for  the  stability  of  large  classes  of  time-variant  and  nonlinear 
feedback  systems. 

Linear  time-invariant  systems,  either  in  the  multivariable  or 
single-input  single-output  case  are  characterized  by  the  semigroup 
of  positive  integers  yielding  the  classical  result  to  the  effect 
that  a causal  operator  admits  a causal  inverse  if  and  only  if  it  is 
homotopic  to  the  identity,  (i.e.  it  lies  in  the  same  connected  com- 
ponent as  the  identity.)  Since  our  homology  is  dependent  only  on 
the  homotopic  equivalence  class  of  an  operator  this  result  can  be 

extended  immediately  to  the  class  of  nonlinear  and  time-variant  oper- 

14 

ators  which  are  homotopic  to  a linear  time- invariant  operator. 

The  open  questions  are:  "how  big 

is  this  class  of  nonlinear  and  time-variant  operators?"  and  "how 
does  one  compute  the  equivalence  class  of  such  an  operator?".  Al- 
though not  universal,  we  believe  that  the  above  described  necessary 
and  sufficient  conditon  for  the  causal  invertibility  (i.e.  stability) 
of  those  nonlinear  and  time-variant  operators  which  are  homotopic 
to  a linear  time-variant  operator  subsumes  the  existing  literature 
on  causal  invertibility.  Indeed,  to  our  knowledge,  every  existing 
sufficient  condition  for  stability  (instability)  is  essentially  a 
proof  that  the  given  return  difference  operator  is  (is  not)  homotopic 

to  the  identity. 

i 
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IV.  Banach  Resolution  Space 

Our  efforts  to  extend  the  resolution  space  concept  to  Banach 

spaces  have  been  directed  along  two  lines  of  inquiry.  first,  we 

have  developed  a causal  operator  factorization  theory  for  positive 

self-adjoint  operators  which  map  a reflexive  Banach  space  to  its 
2 3 2 4 

dual.  * A little  analysis  with  the  classical  theory  will  re- 
veal that  this  is  precisely  the  class  of  operators  with  which  one 


must  deal  when  working  with  systems  defined  in  Banach  space.  For 
Instance,  the  covariance  of  a random  variable  taking  values  in  a 

1 

I 

reflexive  Banach  space,  B,  is  such  an  operator  as  is  the  hermitian 

23  24 

part  of  a passive  impedance.  * The  key  to  this  factorization 

theory  is  the  fact  that  the  given  mapping  is  factored  through  a 

Hilbert  space  rather  than  a Banach  space.  When  applied  to  the  co- 

variance  of  a Banach  space  valued  random  process,  this  implies  that 

its  reproducing  kernel  space  is  Hilbert  space  rather  than  a Banach 

space,  whereas  the  application  of  this  factorization  theory  to  the 

hermitian  part  of  a passive  impedance  defined  in  Banach  space  yields 

2 3 2 4 

scattering  variables  defined  in  Hilbert  space.  ’ 

Although  the  factorization  theory  described  above  is  valid  in 

an  arbitrary  Banach  resolution  space1  the  extension  of  classical 
results  related  to  strict  causality  and  the  additive  operator  de- 
composition requires  additional  structure.  This  is  achieved  by  a 
subclass  of  the  Banach  resoltuion  spaces  termed  Orlicz  resolution 
spaces  which  have  a "pythagorian"  property  which  allows  the 
convergence  arguments  typically  used  in  Hilbert  resolution  space 

1For  the  purpose  of  this  theory  the  self-adjointness  condition 
associated  with  the  resolution  of  the  identity  used  in  Hilbert 
resolution  space  theory  is  subsumed  by  the  simple  requirement 
that  the  resolution  of  the  identity  be  made  up  of  contractive 
idempotents . 


to  be  extended  to  an  Orlicz  resolution  space.  As  such,  virtually 
the  entirety  of  Hilbert  resolution  space  theory  may  be  extended 
to  an  Orlicz  resolution  space.  We,  however,  believe  that  this  is 
the  largest  class  of  Banach  resolution  spaces  to  which  the  classical 
theory  can  be  fully  extended. 
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